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Abstract 

Objective To investigate whether placebo controls should be used in 
the evaluation of surgical interventions. 

Design Systematic review. 

Data sources We searched Medline, Embase, and the Cochrane 
Controlled Trials Register from their inception to November 2013. 

Study selection Randomised clinical trials comparing any surgical 
intervention with placebo. Surgery was defined as any procedure that 
both changes the anatomy and requires a skin incision or use of 
endoscopic techniques. 

Data extraction Three reviewers (KW, BJFD, IR) independently identified 
the relevant trials and extracted data on study details, outcomes, and 
harms from included studies. 

Results In 39 out of 53 (74%) trials there was improvement in the 
placebo arm and in 27 (51%) trials the effect of placebo did not differ 
from that of surgery. In 26 (49%) trials, surgery was superior to placebo 
but the magnitude of the effect of the surgical intervention over that of 
the placebo was generally small. Serious adverse events were reported 
in the placebo arm in 1 8 trials (34%) and in the surgical arm in 22 trials 
(41 .5%); in four trials authors did not specify in which arm the events 
occurred. However, in many studies adverse events were unrelated to 
the intervention or associated with the severity of the condition. The 
existing placebo controlled trials investigated only less invasive 



procedures that did not involve laparotomy, thoracotomy, craniotomy, 
or extensive tissue dissection. 

Conclusions Placebo controlled trial is a powerful, feasible way of 
showing the efficacy of surgical procedures. The risks of adverse effects 
associated with the placebo are small. In half of the studies, the results 
provide evidence against continued use of the investigated surgical 
procedures. Without well designed placebo controlled trials of surgery, 
ineffective treatment may continue unchallenged. 

Introduction 

Modern surgery is changing rapidly. Surgical interventions can 
now be offered to improve function and quality of life not just 
to save life. The improvement in the safety of surgical 
procedures and anaesthesia has facilitated this change.' The 
mortality associated with anaesthesia has decreased from 
between 64 and 100 in 100 000 in the 1940s to between 0.4 and 
1 in 100 000 at present.' " The prevalence of serious adverse 
events related to surgical interventions has remained relatively 
constant over the past 10 years, despite an increase in the number 
of surgical procedures performed each year.'' ^ The postoperative 
death rate is between 1.9% and 4% and in most cases is due to 
the primary disease."^ ' 

The increase in the applications for surgical procedures has been 
driven by a greater involvement of technology in surgical 
procedures. Such technological advances have made many 
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interventions less invasive, more likely to be endoscopic, and 
less resembling typical open surgery, such as laparotomy. 
However, these new procedures are often introduced into 
surgical practice without any formal evaluation of safety and 
efficacy, such as using randomised clinical trials. This is 
because, unlike drug products, such verification is currently not 
mandated by regulatory authorities.'' Furthermore, there is 
generally a scarcity of information reported on the surgical 
learning curves or the iterative development of a new technique. 
Both existing and innovative surgical practice clearly needs to 
be evaluated, and any evaluative method should take account 
of the unique idiosyncrasies and challenges presented by surgical 
interventions. 

In considering any scientific evaluation, it is important to 
remember that an outcome of a surgical treatment is a 
cumulative effect of the three main elements: critical surgical 
element, placebo effects, and non-specific effects.' The critical 
or crucial surgical element is the component of the surgical 
procedure that is believed to provide the therapeutic effect and 
is distinct from aspects of the procedures that are diagnostic or 
required to access the disease being treated." The placebo effects 
are related to the patients' expectation and the "meaning of 
surgery," whereas the non-specific effects are caused by 
fluctuations in symptoms, the clinical course of the disease, 
regression to the mean, report bias, and consequences of taking 
part in the trial, including interaction with the surgeons, nurses, 
and medical staff.' It is reasonable to assume that surgery is 
associated with a placebo effect.""''' Firstly, because invasive 
procedures have a stronger placebo effect than non-invasive 
ones'" and, secondly, because a confident diagnosis and a 
decisive approach to treatment, typical for surgery, usually 
results in a strong placebo effect. '*' 

Placebo controlled randomised clinical trials of surgical 
interventions are relatively uncommon."'" Studies published 
so far have often led to fierce debates on the ethics, feasibility, 
and role of placebo in surgery.'* "' One reason for the poor uptake 
is that many surgeons, as well as ethicists, have voiced concerns 
about the safety of patients in the placebo group. Many of the 
concerns are based on personal opinion, with little supporting 
evidence.'"""' In the absence of any comprehensive information 
on the use of placebo controls in surgery, and the lack of 
evidence for harm or benefit of incorporating a placebo 
intervention, a systematic review of placebo use in surgical trials 
is warranted. 

We assessed whether placebo controls should be used in the 
evaluation of surgical interventions by systematically reviewing 
all clinical trials in which the efficacy of surgery was compared 
with a placebo control. 

Methods 
Selection criteria 

We performed a systematic review adhering to published 
guidance from the Cochrane Collaboration." Studies were 
eligible if they were randomised clinical trials in which the 
efficacy of surgery was compared with placebo. We defined 
surgery as any interventional procedure that changes the 
anatomy and requires a skin incision or the use of endoscopic 
techniques; dental studies were excluded. We used the term 
placebo to refer to a surgical placebo, a sham surgery, or an 
imitation procedure intended to mimic the active intervention; 
including the scenario when a scope was inserted and nothing 
was done but patients were sedated or under general anaesthesia 
and could not distinguish whether or not they underwent the 
actual surgery. We did not limit the inclusion criteria to any 



particular condition, patient group, intervention, or type of 
outcome. We excluded studies investigating anaesthesia or other 
drug substances used perioperatively. 

Search! strategy 

We developed search strategies for three electronic databases: 
Medline (Ovid), Embase (Ovid), and the Cochrane Central 
Register of Controlled Trials. We searched the databases from 
the date of their inception to 14 November 2013, with no 
restriction on language. (See supplementary appendix 1 for 
details of the search terms.) We did not systematically search 
for studies reported only as conference abstracts. 

Three reviewers (KW, IR, BJFD) independently screened the 
initial set of records identified from the search and then screened 
the full text of any potentially relevant articles. Each reviewer 
independently assessed the eligibility of each study, and the 
final list of included studies was agreed by consensus. 

We also screened the references of the relevant articles. 
Furthermore, we searched ClinicalTrials.gov (on 14 November 
2013), a database of registered randomised clinical trials, to 
identify any recently completed or ongoing studies. 

Dealing with duplicate publications 

If several articles reported outcomes from a single trial (that is, 
with the same authors, location, patient population, and 
recruitment dates), we only included the article reporting the 
main outcome for the trial. 

Data extraction 

We used a standardised data extraction form to collect 
information about the characteristics of each study as well as 
the clinical improvement and superiority of the surgical 
intervention compared with the placebo for the main study 
outcome; as reported by the authors in the published article. For 
each study we extracted the year of pubhcation; study 
population; condition; intervention; outcomes; sample size; 
number of participants; number of events, as well as mean and 
standard deviation for continuous outcomes; and serious adverse 
events and whether they were related to the procedure. To reduce 
the chance of errors, the three review authors extracted data 
separately, checked the entries for consistency, and agreed on 
a single set of data. 

Risk of bias assessment 

The three review authors also independently assessed the risk 
of bias in the included studies using the risk of bias tool criteria 
recommended by the Cochrane guidelines."' " In particular we 
assessed the method of random sequence generation; 
concealment of treatment; blinding of participants, care 
providers, and assessors; success of blinding; and use of 
intention to treat analysis. 

Data synthesis 

We assessed the beneficial effect of the surgical intervention 
on the basis of the original conclusions as any improvement in 
the main outcome of the trial and as superiority of the surgical 
treatment over the placebo — that is, the additional benefits of 
the critical surgical element. Moreover, we calculated 
statistically significant difference between the surgical 
intervention and placebo using the information reported in the 
results section of each study. We calculated the odds ratio for 
binary outcomes and the effect size for continuous outcomes 
using the effect estimate from analysis of covariance, the 
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difference in change score, or the difference in postoperative 
score, depending on the method of analysis and data reported 
within each individual study. We included only the primary 
outcome measure, whenever it was explicitly specified. If two 
primary outcomes were reported, we used both; however, when 
there were several main outcome measures, we chose those 
reported in the abstract or those used in other studies, so that 
the forest plots present similar outcomes. Where necessary, we 
changed the direction of effect so that the improvement was 
consistently presented in the same way in the forest plots. 

As a measure of harms, we examined serious adverse events 
and whether they were attributable to the surgical or the placebo 
intervention. An optimal strategy to identify reports of adverse 
events does not exist.^^ We defined serious adverse events as 
harmful events that occurred during the trial, such as prolonged 
hospital stay, and events that required admission to hospital or 
resulted in death. We summarised the serious adverse events 
data using a grading system according to their severity, as 
definitely, likely or unlikely to be serious, and a grading system 
according to relation between the event and the procedure as 
definitely, likely, unlikely to be related to the procedure. 
Wherever possible, we used the results from the intention to 
treat analysis. Most studies did not provide sufficient 
information about harms to enable a formal statistical analysis. 

Owing to the considerable heterogeneity of conditions, 
interventions, and outcomes it was not feasible to combine the 
results of individual studies in a meta-analysis. We present a 
descriptive analysis of the results of each individual study and 
present data in tables and figures. All analyses were carried out 
in Stata (version 12.1). 

Results 
Study selection 

The search of Medline, Embase, and Cochrane databases 
identified a total of 4543 records. We found an additional 23 
articles using a hand search of relevant literature and the 
references of the articles identified using the database search. 
Out of these 4566 records, 1597 duplicates were discarded, 
leaving 2969 records; of these, 2860 did not meet inclusion 
criteria, and a further 56 studies were excluded after reviewing 
the full text of the article. Among them were 12 articles reporting 
additional outcomes of a trial, seven follow-up papers, and seven 
studies that reported results in a way that made the comparison 
between the surgical and placebo arm impossible. This resulted 
in 53 full text articles that met the inclusion criteria and were 
included in this review. Figure 111 details the study identification 
and reasons for exclusion. 

A keyword search of the ClinicalTrials.gov database identified 
14 relevant trials, including two studies already found using the 
electronic search"** and 12 studies that were not yet available 
as full text articles in November 2013. 

Risk of bias assessment 

All included studies were assessed for risk of bias (see 
supplementary appendix 2). The risk of bias related to sequence 
generation, concealment of treatment allocation, and blinding 
during the procedures was generally low. In some trials the 
measures undertaken to maintain blinding were not explicitly 
described; however, these trials used endoscopic techniques in 
patients under general anaesthesia or sedation. Patients and 
assessors were blinded in almost all trials; in the trials in which 
assessors were not blinded, the outcomes were objective. Only 
12/53 (23%) trials assessed whether the blinding was successful. 



including one in which the patients were likely to guess the 
correct allocation." 

Characteristics of the reviewed trials 

Overall, 39 of the 53 (74%) included studies were published 
after 2000. Most of the trials investigated minor and not directly 
life threatening conditions, such as severe obesity (n=7; 13%) 
or gastro-oesophageal reflux (n=6; 11%). The most common 
type of intervention was endoscopy, with 23 trials (43%) using 
this technique as a part of the investigated procedure. Thirteen 
trials (25%) used some exogenous material, implant, or tissue, 
and a further six used balloons. Most studies reported subjective 
outcomes such as pain (n=13; 25%), improvement in symptoms 
or function (n=17; 32%), or quality of life (n=8; 15%). Less 
than half of the trials (n=22; 42%) reported an objective primary 
outcome — that is, measures that did not depend on judgment 
of patients or assessors. The majority of trials were small; the 
number of randomised participants ranged between 10 and 298, 
with a median of 60. No placebo controlled surgical trials 
investigating more invasive surgical procedures such as 
laparotomy, thoracotomy, craniotomy, or extensive tissue 
dissection were identified. Tables ll| and 2I| list the 
characteristics of each trial. 

Clinical benefit of improvement as reported 
by the trials' authors 

In around three quarters (n=38; 72%) of the studies the authors 
reported an improvement in both the surgical group and the 
placebo group (table 3 il). In a further seven trials,""* the clinical 
improvement was observed in the surgical group but not in the 
placebo group; however, in five of these studies,"'" '^ * the 
outcome measures were objective and did not depend on 
patients' ratings. Finally, in six studies no improvement was 
reported in either group," *^ and one study could not be 
interpreted in terms of improvement as the main outcome was 
failure of treatment defined as new or continued bleeding."^ 

Superiority of surgery over placebo as 
reported by the trials' authors 

In half of the included studies (n=26; 49%) the authors reported 
superiority of the surgical procedure over the placebo 
intervention, and in the remaining trials (n=27; 51%) the active 
surgical procedure was not statistically different from that of 
the placebo intervention (table 3). 

Statistically estimated clinical benefit of 
critical surgical element in comparison to 
placebo 

Overall, the magnitude of the treatment effect when the active 
surgical intervention group was compared with the placebo 
group was small but generally favoured the surgical treatment. 
The forest plots in figures 2JJ, and 3\i present the effect sizes and 
odds ratios for individual trials. 

In 12 studies, the surgical intervention was significantly superior 
to placebo (tables 1 and 2 and figs 2 and 3).'"-'" * In 1 1 
studies, the effect of the surgical intervention was significantly 
better for only some of the reported primary outcome 
measures. In 24 studies (45%), there was no statistically 
significant benefit of the active surgical intervention over the 
placebo (tables 1 and 2 and figs 2 and 3). In six studies we could 
not calculate the statistical estimated clinical benefit because 
the results were reported as median values and could not be 
used to calculate an effect size."' 
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Harms 

In just under half of the trials (n=23/53; 43%) the authors stated 
that there were no serious adverse events, although sometimes 
they reported minor adverse events (table 2). Three out of 53 
studies (6%) did not report any information about adverse 
events. In the remaining 27 studies (51%), serious adverse events 
occurred in at least one of the study arms (table 1). In 17 of 
these 27 studies, serious adverse events were observed in both 
the surgical and the placebo arms, in five studies serious adverse 
events were only present in the active group, whereas in four 
studies the authors did not specify in which group the serious 
adverse events occurred. Not all serious adverse events were 
related to the procedure. For example, in six trials on 
gastrointestinal bleeding, deaths, rebleeds, or continuous 
bleeding were the main outcome of the study and were a result 
of the investigated condition and of the procedure being 
ineffective rather than it being harmful. In only two of these 
trials, adverse events, such as a perforation, were directly related 
to the intervention. In several trials, adverse events were rare 
(<5% of patients) or were unrelated to the procedure — for 
example, death from other causes. In general, the placebo arm 
was reported to be safer and adverse events were more serious 
and more common in the active group. 

The interventions in the placebo arm were overall associated 
with less serious adverse events compared with the active arm, 
as the main surgical element was omitted and the authors made 
an effort to minimise risks by withholding part of the 
intervention — for example, partial burr holes rather than full 
trepanation*" or not administering heparin.^' Often the type of 
serious adverse events in the placebo group depended on the 
severity of the investigated condition and the invasiveness of 
the chosen procedure. Moreover, the serious adverse events in 
the placebo group were more likely if the procedures involved 
exogenous material; out of 13 trials using implanted exogenous 
substances, materials, or tissue, eight reported serious adverse 
events.^* 

Of the 27 trials in which serious adverse events occurred, 17 
trials reported events that were related or likely to be related to 
the procedure in the surgical group (table 1). Most of the studies 
did not specify whether the serious adverse events were directly 
or potentially associated with critical surgical element or other 
elements of surgical interventions. Complications in the placebo 
group related or likely to be related to some element of the 
procedure were reported in nine studies. Harms definitely 
directly related to the surgical placebo were reported in two 
studies, and included infections'"' as well as complications related 
to the device and the investigated condition itself''^; both trials 
were stopped early because of concerns about safety. In one of 
the trials on gastrointestinal bleeding, aspiration occurred in 
two patients in the placebo group that could have been related 
to the procedure as well as to the condition."^' 

The only adverse event reported as related to anaesthesia was 
in a trial by Schwartz and colleagues,^' in which one patient in 
the placebo group had a bruise as result of a misplaced 
intravenous line during sedation. 

Discussion 

Surgical randomised chnical trials incorporating a placebo arm 
are rare but this review shows that the results of many of the 
trials provide clear evidence against continued use of the 
investigated surgical procedures and in well designed studies 
the risks of adverse effects are small and the placebo arm is 
safer than surgery. The identified surgical randomised clinical 
trials were heterogeneous. The existing placebo controlled trials 



investigated only less invasive procedures that did not involve 
laparotomy, thoracotomy, craniotomy, or extensive tissue 
dissection. About a half of the reviewed trials showed superiority 
of the surgical procedure over placebo intervention, but the 
magnitude of the effect directly related to the crucial surgical 
element was generally small. The majority of the trials showed 
an improvement in the surgical group as well as in the placebo 
group, which would suggest that some surgical procedures may 
have a placebo effect and that some of the benefits of surgery 
are related to factors other than the crucial surgical element. 

Serious adverse events were reported in half of the reviewed 
trials, and the severity of possible serious adverse events was 
often related to the seriousness of the investigated condition 
and the invasiveness of the chosen procedure. Generally, the 
incidence of complications in the placebo group was lower than 
that in the surgical arm. 

Strengths and weaknesses of this study 

Modern surgery involves not only open surgery but also 
minimally invasive procedures, implants, and transplants; 
therefore, the boundary between surgery and other medical 
procedures was not always clear. In addition, identifying unique 
studies was not always straightforward — that is, differentiating 
between papers reporting two similar trials or different outcomes 
of the same trial. 

Many trials reported several outcomes, often without identifying 
the primary measure. As a consequence we had to report only 
the outcomes for which the study had been powered, those 
reported in the abstract, or those used in other similar studies. 
The lack of a clear primary outcome also meant that we could 
not report a single primary outcome per study. 

The available data only allowed comparison of effects in the 
surgical arm versus the placebo arm and did not allow for any 
estimation of the magnitude of the placebo effect. Interestingly, 
the effects for surgery versus placebo were smaller than 
expected. Only one study included an observational group. 
We specifically chose not to include surgical trials with waiting 
list controls. Analysis of the placebo effect without controlling 
for non-specific effects of being in the trial would be flawed, 
as was pointed out in the comments'''' " in the original paper on 
placebo effects in surgery by Beecher.*^* 

The quality of the included studies varied. Many studies were 
small and used several primary outcome measures or cumulative 
measures or used a subgroup analysis without comparisons 
between groups. Reporting of adverse events was poor and many 
authors did not specify the primary cause of the complications 
or in which group they occurred. In the recent trials, the adverse 
events were described in more detail, but further improvement 
is required.''' The standardised way of reporting harms was 
published only in 2004.'" 

Possible benefits and harms and implications 
for clinicians and policy makers 

The main benefit and value of placebo controlled randomised 
clinical trials is their ability to show the real efficacy of a 
surgical intervention. If a procedure is effective and superior 
over the placebo, the case is strong for it to be commissioned 
and funded. The opposite is also true; if a surgical procedure 
has no benefit over placebo the argument is strong for stopping 
its use. The well designed placebo controlled trial of surgery is 
a useful tool to challenge the continued commissioning and use 
of ineffective treatments. 
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The trial participants usually gain direct benefits, the main one 
being the perceived improvement attributable to the intervention. 
Whether this is acceptable by doctors and patients is the subject 
of an ongoing debated' Indirect benefits may include 
confirming or disproving the primary diagnosis thereby allowing 
patients to be referred for a more appropriate treatment. A 
reduced waiting time or receiving treatment free of charge (for 
treatment that is ordinarily paid for by patients) is a further 
potential advantage of taking part in a trial. 

In the modern clinical setting the distinction between the 
research and treatment is less clear and these two are often 
integrated. The balance between benefits and overall risk to a 
patient in a trial and in standard clinical care are usually not 
much different, as both the clinical outcomes and the additional 
risks and inconveniences caused by additional assessments are 
not great.'-' 

The negative consequences for the trial patients may be 
considered mainly in terms of harms. In most of the trials, the 
investigated conditions were non-life threatening and the main 
aim of surgery was to improve function, symptoms, and quality 
of life, to reduce pain, or to remove the need for drug use. In 
these trials the harms were either lack of improvement or 
complications arising from the procedure, such as perforation 
after endoscopy. In the trials on gastrointestinal bleeding, the 
investigated condition was potentially life threatening and the 
procedure was not elective. In these six trials the negative events, 
such as bleeding and deaths, were the primary outcome and an 
indicator that the intervention was ineffective. 

Placebo controlled surgical trials raise important ethical 
concerns"*"" but are justified when there is a genuine equipoise"; 
that is, a disagreement in the medical community about whether 
one treatment is superior to another, because standard treatment 
does not exist or its efficacy is questioned. 

Such trials conform to the ethical principles of 
non-maleficence — that is, the duty not to inflict expected harm, 
and justice.^' Surgical intervention may be associated with 
greater risk than drug intervention; therefore, to be justified it 
must be associated with greater "pure" benefit to outweigh such 
risks. Surgical trials are justified by equipoise not only when 
there is uncertainty about pure benefit, but also when there is 
uncertainty about whether benefit outweighs harms. 

If a standard medical treatment is available, it may be offered 
as a part of the study, as in the trials on tissue transplantation 
in Parkinson' s disease, in which the participants continued their 
L-dopa drug. In addition to that, if one of the treatments in the 
trial becomes recognised as effective or a new treatment 
becomes available during the conduct of the trial, equipoise is 
disturbed and ethically the study should be stopped, as was the 
case in one trial''' where the intervention was accepted by the 
insurer as a standard procedure and the trial was terminated 
early, before it could show the superiority of the active 
procedure. 

Another ethical concern is deception and risk to the trust 
between patients and surgeons. In the majority of studies and 
always in the recent trials, patients were informed about taking 
part in a placebo controlled trial, and informed consent was 
obtained. In the study by Moseley and colleagues, participants 
were also asked to write a clause in their notes acknowledging 
the fact that they might receive placebo intervention and that 
placebo might not be effective.'' If patients are fully informed 
and give proper consent, then from the ethical point of view the 
conditions of free consent and autonomy are fulfilled. 

Surgery of any form, including placebo surgery, is associated 
with some level of risk, whereas a placebo tablet or drug is not. 



Therefore the balance between risks and benefits in surgical 
placebo controlled randomised clinical trials is different from 
that in drug trials. In most of the studies that reported serious 
adverse events, such complications were expected in the 
investigated conditions; even in the study on Alzheimer's 
disease, mortality was comparable with other trials." What 
matters most is that risk is minimised and that actual harm is as 
small as possible.™ '* In the reviewed trials, the placebo arm 
was usually designed to pose as little risk to the participants as 
possible and to be significantly less risky than the active surgical 
procedure. 

In a situation where there is no certainty that the surgery is 
effective, the balance between risks and benefits within a study 
actually may be better in the placebo arm. For example, in the 
trials on fetal nigral tissue transplantation for Parkinson' s 
disease, the active treatment was no better than placebo in terms 
of outcome and resulted in more severe side effects, such as 
dystonias and dyskinesias. Moreover, the risk of infection and 
other complications associated with the actual tissue 
implantation was much higher than the risk in the placebo group. 
Interestingly, in the study by Freed and colleagues,^* patients 
who had been in the placebo group still opted for the surgical 
procedure after the trial, despite the fact that no clear benefit of 
fetal nigral tissue transplantation had been shown. This may be 
because patients believe that invasive,'^ new,™ and expensive*" 
procedures are actually more effective. 

Effects of existing trials on cliange in practice 

The results of the placebo controlled surgical trials performed 
so far have had a varied impact on clinical care. With the 
exception of the trials on debridement for osteoarthritis" or 
internal mammary artery ligation for angina,*' most of the trials 
did not result in a major change in practice. Moseley' s study 
on debridement for knee osteoarthritis was well received and 
resulted in limiting the recommendations for debridement and 
lavage for osteoarthritis of the knee to patients only with clear 
mechanical symptoms such as locking.*' The reaction of the 
medical community to the trials on tissue transplantation to treat 
Parkinson's disease was also favourable. Although this treatment 
is not currently recommended,*' the need for more studies on 
mechanisms of disease and on tissue transplantation is 
recognised.*"" *"* These studies also provoked a discussion about 
ethical aspects of randomised clinical trials and placebo.'* " ^' *' 

In contrast, the results of the trials on the efficacy of 
vertebroplasty'"^ " were challenged and their authors were 
criticised for undermining the evidence supporting this 
commonly used procedure. The critics acknowledged that the 
injection of cement might be associated with many side effects, 
some of them potentially dangerous, but they argued that the 
treatment was justified because earlier unblinded trials had 
shown superiority of vertebroplasty over medical treatment.''' ''* *'' 
This argument against the validity of placebo controlled trials 
neglected any potential placebo effect of vertebroplasty. 

Unanswered questions and future research 

The placebo component of surgery has to be explored and better 
understood. Future surgical trials need to be better designed and 
to include the observational control arm to allow the estimation 
of the magnitude of the placebo effect while controlling for 
non-specific factors such as spontaneous improvement or 
regression to the mean. We need to know the size of these effects 
and factors that influence their magnitude in order to properly 
interpret results of clinical trials in general, especially as many 
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surgical trials nowadays use an observational design or case 
registers. 

Placebo controlled trials in surgery are as important as they are 
in medicine, and they are justified in the same way. They are 
powerful, feasible way of showing the efficacy of surgical 
procedures. They are necessary to protect the welfare of present 
and future patients as well as to conduct proper cost 
effectiveness analyses. Only then may publicly funded surgical 
interventions be distributed fairly and justly. Without such 
studies ineffective treatment may continue unchallenged. 

As surgery is inherently associated with some risk, it is 
important that the surgical treatment is truly effective and that 
the benefits outweigh the risks. Placebo controlled surgical trials 
are not free from adverse events but risks are generally minimal 
in well designed trials and the control arm is much safer than 
the active treatment. However, this review highlighted the need 
for better reporting of trials, including serious adverse events 
and their relation to a particular element of surgical procedure. 

A need exists to "demystify" and extend the use of the surgical 
placebo in clinical trials. These should result in a greater 
acceptance of this type of trial by the surgical community, ethics 
committees, funding bodies, and patients. In turn, this would 
lead to more studies, better guidelines on the design and 
reporting of studies, and a larger body of evidence about efficacy 
and the risks of surgical interventions. Placebo controlled 
surgical trials are highly informative and should be considered 
for selected procedures. 
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What is already known on this topic 

Placebo controlled randomised clinical trials on efficacy of surgical procedures are rare and the main concerns are related to the benefits 
and harms related to such trials 

What this study adds 

In many of the reviewed trials improvement was present in both arms suggesting that the clinical effect may not be a result of the surgery; 
moreover, statistical superiority of the surgical procedure over the placebo was small 

The absence of an observational or non-treatment control group in most studies precludes any evaluation of the magnitude of the placebo 
effect 

Placebo controlled surgical trials are not free from adverse events, but the harms can be minimised and the placebo arm is generally 
much safer than the surgery arm 

Placebo controlled trials of surgery are a powerful, feasible way of showing the efficacy of surgical procedures and without them ineffective 
treatment may continue unchallenged 
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Table I Characteristics of reviewed trials reporting serious adverse events 





















Serious adverse 
eventtt 










Primary 
outcomes 










Surgery 


Placebo 


Reference 


Condition 


Intervention 


Ex 


No 


Improvement 


Superior 


Significant* 


Ser 


Rel 


Ser 


Rel 


Silverberg 
et al 2008 


Alzheimer's 
disease 


Ventriculoperitoneal shunt 


Y 


Clinical 
assessment 


230 


N 


ND 


N 


Y 


Y 


Y 


Y 


Kallmes et 
al 2009 


Osteoporotic 

vertebral 

fractures 


Percutaneous vertebroplasty 


Y 


Pain, function 


131 


Both study 
arms 


ND 


N 


Y 


Yt 


Y 


Lt 


Castro et al 
2010 


Severe asthma Radiofrequency bronchial 
thermoplasty 


N 


Quality of life 


297 


Both study 
arms 


Surgical 


Y/N 


Y 


Yt 


Y 


Lt 


Gross et al 
2011 


Parkinson's 
disease 


Human cells transplantation 


Y 


Clinical 
assessment 


71 


Both study 
arms 


ND 


N 


Y 


Y 


Y 


U 


Freed et al 
2001 


Parkinson's 
disease 


Dopamine neurons 
transplantation 


Y 


Perception of 
change 


40 


N 


ND 


N 


Y 


L 


Y 


ut 


Stone et al 
2002 


Coronary 
disease 


PMLR 


N 


Function 


141 


Both study 
arms 


ND 


Y 


Y 


L 


Y 


L* 


Salem et al 
2004 


Coronary 
disease 


PMLR 


N 


Clinical 
assessment 


82 


Both study 
arms 


Surgical 


Y 


Y 


L 


Y 


L 


Abbott et al 
2004 


Endometriosis 


Laparoscopy+excision 


N 


Pain, quality 
of life 


39 


Both study 
arms 


Surgical 


Y/N 


Y 


L 


Y 


ut 


Lee et al 
2001 


Urinary stress 
incontinence 


Autologous fat injection 


N 


Symptoms, 
function, 
objective test 


68 


Both study 
arms 


ND 


N 


Y 


Y 


L 


Y 


Dowson et 
al 2008 


Migraine 


Patent foramen ovale closure 


Y 


Pain 


147 


N 


ND 


N 


Y 


Y 


L 


L 


Hartigan et 
al 1994 


Oesophageal 
varices§ 


Endoscopy+sclerotherapy 


N 


Bleeding, 
death 


253 


NR 


Surgical 


N 


Y 


t 


Y 


t 


Fleischer et 
al 1985 


Bleeding 

esophageal 

varices§ 


Endoscopy+laser 


N 


Bleeding 


20 


Surgical 


Surgical 


Y/N 


Y 


Yt 


Y 


Yt 


Fullarton et 
al 1989 


Bleeding peptic Endoscopy+heater probe 
ulcers§ 


N 


Bleeding 


43 


Surgical 


Surgical 


Y/N 


Y 


Yt 


Y 


t 


Freitas et al 
1985 


Bleeding peptic Endoscopy+electrocoagulation 
ulcers§ 


N 


Bleeding, 
death 


78 


Both study 
arms 


Surgical 


N 


Y 


t 
1 


y 


t 
1 


MacLeod et 
al 1983 


Bleeding peptic Endoscopy+laser 

ulcers§ 


N 


Bleeding, 
death 


45 


Both study 
arms 


Surgical 


N 


Y 


-j- 


Y 


j- 


Laine et al 
1987 


Upper 

gastrointestinal 
tract bleeding§ 


Endoscopy+electrocoagulation 


N 


Bleeding, 
death 


44 


Both study 
arms 


Surgical 


Y/N 


Y 


f 


Y 


j- 


Leon et al 
2005 


Coronary disease PMLR 




N Function 


298 Both study 
arms 


ND 


N 


Y 


L* 


Y 


Lt 


Corley et al 
2003 


GERD 


Radiofrequency surgery 


N 


Symptoms, 
quality of life 


64 


Both study 
arms 


Surgical 


N 


U 


L 


Y 


L* 


Geenen et 
al 1989 


Sphincter of 
Oddi 

dysfunction 


Endoscopic 
sphincterotomy+ERCP 


N 


Symptoms, 
objective test 


47 


Both study 
arms 


Surgical 


Y 


t 


Y 


t 


Y 


Buchblnder 
et al 2009 


Osteoporotic 

vertebral 

fractures 


Percutaneous vertebroplasty 


Y 


Pain 


78 


Both study 
arms 


ND 


N 


t 


L 


t 


L 


Thompson 
et al 2013 


Obesity 


Transoral outlet reduction 


N 


Objective test 


77 


Surgical 


Surgical 


Y 


t 


U 


t 


U 


Pauza et al 
2004 


Discogenic low 
back pain 


Intradiscal electrothermal 
therapy 


N 


Pain, function, 
quality of life 


64 


Both study 
arms 


Surgical 


Y/N 


t 


U 


t 


U 


Swank et al 
2003 


Chronic 
abdominal pain 


Laparoscopy+adhesiolysis 


N 


Pain, quality 
of life, drugs 


100 


Both study 
arms 


ND 


Y/N 


Y 


Y 


N 


N 



No commercial reuse: See rights and reprints http://www.bmj.com/permissions Subscribe: http://www.bmi.com/subscribe 



e/WJ2014;348:g3253doi: 10.1136/bmj.g3253 (Published 21 May 2014) Page 9 of 15 



RESEARCH 



Table 1 (continued) 

Serious adverse 
eventtt 



Primary Surgery Placebo 



Reference 


Condition 


Intervention 


Ex 


outcomes 


No 


Improvement 


Superior 


Significant* 


Ser 


Rel 


Ser 


Rel 


Deviere et 
al 2005 


GERD 


Endoscopy+copolymer 


Y 


Drugs 


64 


Botfi study 
arms 


Surgical 


Y 


Y 


Yt 


N 


N 


Rothstein et 
al 2007 


GERD 


Endoscopy+plication 


N 


Quality of life 


159 


Botfi study 
arms 


Surgical 


Y 


Y 


L 


N 


N 


Shaheen et 
al 2009 


Barrett's 
oesophagus 


Radlofrequency ablation 


N 


Clinical 
assessment 


127 


Botfi study 
arms 


Surgical 


Y 


Y 


L* 


N 


N 




Olanow et 
al 2003 


Parkinson's 
disease 


Fetal tissue transplantation 


Y 


Clinical 
assessment 


34 


N 


ND 


N 


Y 


U 


N 


N 



Ex=exogenous material used; lmp=lmprovement as originally reported by the trial's authors, Sup=superiorlty of one arm over other as originally reported by trials' 

authors; No=number of patients randomised into trial; Sig=statlstical significance of one arm over the other as calculated by us; Ser=whether adverse events were 

serious; Rel=whether serious adverse events were relevant to the procedure; ND=no difference; Y=yes; N= no; Y/N=yes or no depending on outcome; L=likely to 

be serious or related to the procedure; U=unllkely to be serious or related to procedure; PMLR=percutaneous myocardial laser revascularisation; NR=not reported; 

GERD=gastro-oesophageal reflux disease; ERCP=endoscoplc retrograde cholangiopancreatography. 

•Statistical significance of effect as calculated by us using reported values. 

tSerious adverse events were direct consequence of investigated conditions not interventions. 

ttGraded according to severity; definitely serious (Y), that Is, reported as serious adverse events by trial authors; likely to be serious (L), that Is, not specifically 
reported as serious but resulting In death or admission to hospital; and unlikely (U) to be serious or reported as minor adverse events. Adverse events were also 
graded according to causality as definitely related to the procedure (Y), that Is, reported by trials' authors as such; likely to be related to the procedure (L) as 
classified by us on basis of details reported by trials' authors; and unlikely to be related to the procedure or reported by trials' authors as unrelated to the procedure 
(U). 

^Trials' authors did not specify arm In which adverse events occurred. 

§Trials on upper gastrointestinal ulcers or varices in which bleeding or death were the primary outcome. 
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Table 2| Characteristics of reviewed trials not reporting serious adverse events 

Serious adverse event 



Primary ^"^^^^^ 



Reference 


Condition 


Intervention 


Ex 


outcomes 


No 


Impr 


Sup 


Significant* 


Ser 


Rel 


Ser 


Rel 


Guyron et al 
2009 


Migraine 


"Deactivation" of trigger 
points 


N 


Pain 


76 


Both study 
arms 


Surgical 


Y/N 


N 


N 


N 


N 


Scolapio et al 
2001 


Dysphagia 


Endoscopy+B dilation 


N 


Function 


86 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Bajbouj et al 
2009 


Globus 
sensation 


Endoscopy+ablatlon of 
inlet patches 


N 


Symptoms 


21 


Surgical 


Surgical 


Y 


N 


N 


N 


N 


Artsetal 2012 


GERD 


Radiofrequency 
surgery 


N 


Objective test 


22 


Surgical 


Surgical 


Y 


N 


N 


N 


N 


Montgomery et 
al 2006 


GERD 


Endoscopic 
gastroplasty 


N 


Objective test, 
quality of life, 
drugs 


46 


Both study 
arms 


ND 


NR 


N 


N 


N 


N 


Schwartz et al 
2007 


GERD 


Endoscopic 
gastroplasty 


N 


Symptoms, 
drugs 


60 


Both study 
arms 


Surgical 


Y/N 


N 


N 


N 


N 


Gellebter et al 
1990 


Obesity 


Endoscopy+B 


B 


Objective test 


10 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Hogan et al 
1989 


Obesity 


Endoscopy+B 


B 


Objective test 


59 


Both study 
arms 


ND 


NR 


N 


N 


N 


N 


LIndor et al 
1987 


Obesity 


Endoscopy+B 


B 


Objective test 


22 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Mathus-Vllegen 
etal 1990 


Obesity 


Endoscopy+B 


B 


Objective test 


28 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Meshklnpour et 
al 1988 


Obesity 


Endoscopy+B 


B 


Objective test 


23 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Genco et al 
2006 


Obesity 


Endoscopy+B 


B 


Objective test, 
death 


32 


Both study 
arms 


Surgical 


Y 


N 


N 


N 


N 


Bradley et al 
2002 


Osteoarthritis 


Tidal irrigation 


N 


Pain, function 


180 


Both study 
arms 


ND 


Y/N 


N 


N 


N 


N 


Moseley et al 
2002 


Osteoarthritis 


Arthroscopic 
debridement or lavage 


N 


Pain 


180 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Freeman et al 
2005 


DIscogenIc 
low back pain 


Intradiscal 

electrothermal therapy 


N 


Pain, quality of 
life, clinical 
assessment 


57 


N 


ND 


N 


N 


N 


N 


N 


Baeck et al 
2009 


Sleep apnoea 


Radiofrequency 
surgery 


N 


Objective test, 
symptoms, 
quality of life 


32 


N 


ND 


NR 


N 


N 


N 


N 


Gillespie et al 
2011 


Sleep apnoea 


Palatal implants 


Y 


Objective test 


51 


Placebo 


ND 


N 


N 


N 


N 


N 


Maurer et al 
2012 


Sleep apnoea 


Palatal implants 


Y 


Objective test 


22 


Both study 
arms 


ND 


N 


N 


N 


N 


N 


Friedman et al 
2008 


Sleep apnoea 


Palatal implants 


Y 


Objective test 


62 


Surgical 


Surgical 


Y 


N 


N 


N 


N 


Steward et al 
2008 


Sleep apnoea 


Palatal implants 


Y 


Objective test, 
function 


100 


Both study 
arms 


Surgical 


N 


N 


N 


N 


N 


van Schle et al 
2000 


Diabetic foot 


Silicone injection 


Y 


Clinical 
assessment 


28 


Surgical 


Surgical 


NR 


N 


N 


N 


N 


Davys et al 
2005 


Plantar 
callosities in 
RA 


Debridement of 
callosity 


N 


Pain 


38 


Both study 
arms 


ND 


NR 


N 


N 


N 


N 


Sutton et al 
1994 


Endometriosis Laparoscopy+laser 


N 


Pain, 

symptoms 


74 


Both study 
arms 


Surgical 


Y 


N 


N 


N 


N 


Jarrell et al 
2005 


Endometriosis Laparoscopy+exclslon 


N 


Pain 


29 


Both study 
arms 


ND 


NR 


NR 


NR 


NR 


NR 




Thomson et al 
1981 


Meniere's 
disease 


Decompression 


N 


Symptoms, 

clinical 

assessment 


30 


Both study 
arms 


ND 


N 


NR 


NR 


NR 


NR 
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Table 2 (continued) 

















Serious adverse event 






Primary 
Ex outcomes 










Surgery 


Placebo 


Reference Condition 


Intervention 


No 


Impr 


Sup 


Significant* 


Ser Rel 


Ser Rel 


Stuck et al 2005 Snoring 


Radiofrequency 
surgery of soft palate 


N Symptoms 


26 


Both study 
arms 


Surgical 


Y/N 


NR NR 


NR NR 



Ex=exogenous material used; lmp=improvement as originally reported by the trial's authors, Sup=superiority of one arm over other as originally reported by trials' 
authors; No=number of patients randomised into thai; Sig=statistical significance of one arm the over other as calculated by us; Ser=whether adverse events were 
serious; Rel=whether serious adverse events were related to the procedure; ND=no difference; Y=yes; N= no; Y/N=yes or no depending on outcome; L=likely to 
be serious or related to the procedure; B=balloon; U=unlikely to be serious or related to the procedure; GERD=gastro-oesophageal reflux disease; NR=not reported; 
RA=rheumatoid arthritis. 

'Statistical significance of effect as calculated by us using reported values. 
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Table 3| Outcomes as reported by trials' authors 





Superiority 






Intervention 


No difference 


Surgery 


Total 


Surgery and placebo 


20 


18 


38 


Surgery only 


0 


7 


7 


Placebo only 


1 


0 


1 


Neither surgery nor placebo 


6 


0 


6 


NA 


0 


1 


1 


Total 


27 


26 


53 


NA=outcome was prevention of deatfi so trial cannot be interpreted In terms of Improvement. 
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Figures 



Medline 
1946 to Nov 2013 
(n=1862) 

~ 1 


Embase 
1974 to Nov 2013 
(n=2260) 
1 


Cochrane Central 
(Trials) 1966 to 
Nov 2013 (n=421) 
1 


Hand searching for 
additional records 
(n=23) 1 
1 


\ 




Records after duplicates removed (n=2969) 









Records excluded (n=2860): 
Drugs (n=2307) 
Not surgical (n=386) 
Not placebo (n=ll) 
Ethics or comments (n=151) 
Conference abstract (n=5) 




Full text articles assessed for eligibility (n=109) 



Full text articles excluded (n=56): 
Drugs (n=9) 
Design/methods (n=6) 
Not placebo (n=7) 
Review (n=3) 
Pilot (n=3) 
Case report (n=l) 
Meta-analysis (n=l) 
Additional reports (n=12) 
Follow-up papers (n=7) 
Comparison between groups 
not possible (n=7) 




Studies included in systematic review (n=53) 



Fig 1 Flow chart of study identification, listing first reason for exclusion during review process 
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Implant v placebo 
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Plication vplacebo 
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^^7 tn 1 ") 1 "JI 


bcnwarTZ ei ai 2u\}/ 


EndoCinch vp lace bo 


Proton pu m p i n h i bito r use 
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Proton pump inhibitor use 
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Sphincter of Oddi dysfunction 












Coan on ot al 1QPQ 
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Improvement in symptoms 






A^^n ^^tn1^^7l 
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Sleep spnoes/liypopnoes 












QtomiarH ot al TfinS 


Implant vplacebo 


Reduction on apnoea-hypopnoea index 






^ OQ rn QO tn Q ^S"! 
j.\jy \\),yy 10 y.DOj 


Meniere s disease 












Thnmcpn pt al 1 QS31 
IllUlllbcll cLdl lyGl 


bndolympnatic snunt v ma sto idectomy 


Improvement in symptoms 






n 1 H ("n ni tn a 9 O 


Endometriosis 












ADDOIl ei ai zUU4 


Immediate surge ry vdelayed surgery 


Improvement in pain 






C5.0/ [Z.U L 10 i/.io) 


Sutton etal 1994 


Laser ablation vplacebo 


Improvement in pain 






5.71 (1.89to 17.25) 


Migraine 












Dowson etal 2008 


Implant vplacebo 


Cessation of migraine attacl<s 






0.99 (0.19 to 5.05) 


Guyron et al 2009 


Surgery v placebo 


Reduction in migraine attacl<s 






3.76 (1.27to 11.13) 


Guyron et al 2009 


Surgery v placebo 


Cessation of migraine attacl<s 






1.82 (0.69 to 4.76) 


Urinary stress incontinence 












Lee et al 2001 


Fat injection v placebo 


No leakage/incontinence 






1.10 (0.31 to 3.93) 


Severe asthma 












Castro etal 2010 


Bronchial the rmo plasty v placebo 


Improvement in asthma quality of life 






2.08 (1.21 to 3.58) 



0.00036 1 2774 

Favours placebo Favours treatment 

Fig 2 Forest plot of studies with binary outcome measures showing magnitude of effect (odds ratios) in active group 
compared with placebo group. GERD-HRQL=gastro-oesophageal reflux disease health related quality of life 
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study 

Osteoarthritis 

Bradley etal 2002 

Bradley et al 2002 

Moseley et al 2002 

Moseley et al 2002 
Severe asthma 

Castro etal 2010 
Coronary disease 

Leon et al 2005 

Leon etal 2005 

Stone et al 2002 
Obesity 

Mathus-Vliegen etal 1990 

Mathus-Vliegen et al 1990 

Geliebteretal 1990 

Lindoretall987 

Meshkinpouret al 1988 

Genco etal 2006 

Genco etal 2006 

Thompson et al 2013 
Gastro-oesophageal reflux 

Arts etal 2010 

Corleyetal 2003 

Corleyetal 2003 

Schwartz et al 2007 

Schwartz etal 2007 

Schwartz etal 2007 

Schwartz etal 2007 
Sleep apnoea/hypopnoea 

Friedman etal 2008 

Gillespie etal 2011 

Maurer et al 2012 

Steward etal 2008 

Steward etal 2008 
Snoring 

Stuck etal 2005 

Stuck etal 2005 
Endometriosis 

Abbott et al 2004 

Abbott etal 2004 
Chronic abdominal pain 

Swank et al 2003 

Swank et al 2003 
Alzheimer's disease 

Silverberg et al 2008 
Parldnson's disease 

Gross et al 2011 

Freed et al 2001 

Olanow etal 2003 

Olanow et al 2003 
Chronic discogenic pain 

Freeman et al 2005 

Pauza etal 2004 

Pauza etal 2004 
Osteoporotic vertebral fracture 

Kallmes et al 2009 

Kallmesetal 2009 

Buchbinder etal 2009 



Comparison groups 

Tidal irrigation vplacebo 
Tidal irrigation v placebo 
Lavage ^' placebo 
Debridement i/ placebo 

Bronchial thermoplasty v placebo 

Laser (high dose) i/ placebo 
Laser (low dose) v placebo 
Laseri/ placebo 

Balloon v placebo 
Balloon V placebo 
Balloon V placebo 
Balloon vplacebo 
Balloon 1/ placebo 
Balloon placebo 
Balloon i^placebo 
Outlet reduction u placebo 

Stretta procedure RF v placebo 
RF u placebo 
RF v placebo 
EndoCinch vplacebo 
EndoCinch vplacebo 
Placebo vobsen/ation group 
Placebo vobservation group 

Implant v placebo 
Implant vplacebo 
Implantvplacebo 
Implant v placebo 
Implantvplacebo 

RF V placebo 
RF V placebo 

Immediate surgery v delayed surgery 
Immediate surgery vdelayed surgery 

Adhesiolysis v placebo 
Adhesiolysis v placebo 

CSF drainage v placebo 

Transplantation vplacebo 
Transplantation vplacebo 
Transplantation 4 donors v placebo 
Transplantation 1 donor v placebo 

Electrothermal therapy vplacebo 
Electrothermal therapy vplacebo 
Electrothermal therapy v placebo 

Vertebro plasty vplacebo 
Vertebroplasty v placebo 
Vertebroplasty vplacebo 



Effect size (95% CI) 



WOIMAC pain 
WOMAC function 
KSPS pain 
KSPS pain 

Asthma quality of life 

Exercise tolerance 
Exercise tolerance 
Exercise tolerance 

Weight loss (kg) 
Weight loss (BIV\1) 
Weight loss (kg) 
Weight loss (kg) 
Weight loss (kg) 
Weight loss (kg) 
Weight loss (BIV\1) 
Weight loss (%) 

Gastrointestinal distensibillty 
Heartburn symptoms 
GERD-HRQL 
Heartburn score 
Regurgitation score 
Heartburn score 
Regurgitation score 

Apnoea-hypopnoea Index 
Change in CPAP pressure 
Apnoea-hypopnoea Index 
Apnoea-hypopnoea Index 
ESS 

Visual analogue scale snoring 
ESS 

Visual analogue scale pain 
EQ5D 

Visual analogue scale pain 
SF-36 pain 



UPDRS during off state 
Rating of parkinsonism 
UPDRS during off state 
UPDRS during off state 

SF-36 physical 
Visual analogue pain 
GDI 

RMS 

NRS pain 
NRS pain 



Effect size (95% CI) 

0.35 (0.05 to 0.65) 
0.28 (-0.01 to 0.58) 
0.09 (-0.4 to 0.29) 
0.01 (-0.37 to 0.39) 

0.16 (-0.08 to 0.41) 

0.15 (-0.13 to 0.43) 
0.22 (-0.06 to 0.49) 
0.50 (0.1 7 to 0.84) 

-0.25 (-1.01 to 0.50) 
-0.23 (-0.99 to 0.52) 
0.38 (-0.50 to 1.27) 
0.61 (-0.27 to 1.48) 
0.14 (-0.55 to 0.84) 
2.79 (1.80 to 3.78) 
1.89 (1.05 to 2.73) 
0.50 (0.02 to 0.97) 

1.55 (0.50to2.60) 
0.40 (-0.16 to 0.95) 
0.43 (-0.13 to 1.00) 
1.09 (0.43 to 1.76) 
0.62 (-0.01 to 1.26) 
-0.48 (-1.14 to 0.18) 
0.14 (-0.50 to 0.79) 

1.39 (0.80 to 1.98) 
-0.18 (-0.74 to 0.37) 
0.78 (-0.14 to 1.69) 
0.34 (-0.06 to 0.75) 
0.05 (-0.35 to 0.45) 

1.19 (0.30 to 2.08) 
0.13 (-0.69 to 0.95) 

-0.28 (-0.91 to 0.35) 
0.12 (-0.50 to 0.75) 

0.45 (0.05 to 0.85) 
0.40 (-0.00 to 0.80) 

0.19 (-0.12 to 0.50) 

0.04 (-0.44 to 0.52) 
0.21 (-0.42 to 0.84) 
-0.30 (-1.12 to 0.52) 
0.42 (-0.43 to 1.27) 

0.36 (-0.20 to 0.92) 
0.45 (-0.08 to 0.99) 
0.69 (0.1 5 to 1.24) 

0.16 (-0.19 to 0.50) 
0.24 (-0.11 to 0.59) 
0.23 (-0.24 to 0.69) 



-3.78 0 3.78 

Favours placebo Favours treatment 

Fig 3 Forest plot of studies with continuous outcome measures showing magnitude of effect (effect sizes) in active group 
compared with placebo group. Outcome values in Stone and colleagues trial were not normally distributed; therefore, the 
effect size does not represent the true difference. WOMAC=Western Ontario and McMaster Universities arthritis index; 
KSPS=knee specific pain scale; OoL=quality of life; BMl=body mass index; GERD-HROL=gastro-oesophageal reflux disease 
health related quality of life; NRS=numerical rating scale; RF=radiofrequency; SF-36=short form (36) health survey; 
CSF=cerebrospinal fluid; UPDRS=unified Parkinson's disease rating scale; E05D=EuroOol Group health questionnaire; 
RMS=modified Roland-Morris scale; ODl=Oswestry disability index; ESS=Epworth sleepiness scale; MDRS=Mattis dementia 
rating scale 
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